Playing games against nature: optimal policies for renewable resource allocation

نویسندگان

  • Stefano Ermon
  • Jon Conrad
  • Carla P. Gomes
  • Bart Selman
چکیده

In this paper we introduce a class of Markov decision processes that arise as a natural model for many renewable resource allocation problems. Upon extending results from the inventory control literature, we prove that they admit a closed form solution and we show how to exploit this structure to speed up its computation. We consider the application of the proposed framework to several problems arising in very different domains, and as part of the ongoing effort in the emerging field of Computational Sustainability we discuss in detail its application to the Northern Pacific Halibut marine fishery. Our approach is applied to a model based on real world data, obtaining a policy with a guaranteed lower bound on the utility function that is structurally very different from the one currently employed.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A TRANSITION FROM TWO-PERSON ZERO-SUM GAMES TO COOPERATIVE GAMES WITH FUZZY PAYOFFS

In this paper, we deal with games with fuzzy payoffs. We proved that players who are playing a zero-sum game with fuzzy payoffs against Nature are able to increase their joint payoff, and hence their individual payoffs by cooperating. It is shown that, a cooperative game with the fuzzy characteristic function can be constructed via the optimal game values of the zero-sum games with fuzzy payoff...

متن کامل

Gradient Methods for Stackelberg Security Games

Stackelberg games are two-stage games in which the first player (called the leader) commits to a strategy, after which the other player (the follower) selects a best-response. These types of games have seen numerous practical application in security settings, where the leader (in this case, a defender) must allocate resources to protect various targets. Real world applications include the sched...

متن کامل

Resource re-allocation at network units by using of bi-level data envelopment analysis

The lack of renewable primary resources is one of the most serious challenges in recent decades. So under this circumstance, managers are looking for appropriate solutions for the optimal use of these resources to improve the efficiency of the under management units.  One of the most widely used techniques in finding the optimal resource is data envelopment analysis (DEA). So in this paper, in ...

متن کامل

Long-term Care Financing: Inserting Politics and Resource Allocation in the Debate; Comment on “Financing Long-term Care: Lessons From Japan”

The ageing of the countries’ populations, and in particular the growing number of the very old, is increasing the need for long-term care (LTC). Not surprisingly, therefore, the financing of LTC systems has become a crucial topic across the Organisation for Economic Co-operation and Development (OECD). In the last three decades, various financing policies have been carr...

متن کامل

On Capturing Rent from a Non-renewable Resource International Monopoly: Prices Versus Quantities

In this paper we model the case of an international non-renewable resource monopolist as a dynamic game between a monopolist and  importing countries governments, and investigate whether a tariff on resource imports can be advantageous for consumers in importing countries. We analyze both the case of a price-setting monopolist and the case of a quantity-setting monopolist. We find that a tarif...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010